Automatic Alignment Between Classroom Lecture Utterances and Slide Components
نویسندگان
چکیده
Multimodal alignment between classroom lecture utterances and lecture slide components is one of the crucial problems to realize a multimodal e-Learning application. This paper proposes the new method for the automatic alignment, and formulates the alignment as the integer linear programming (ILP) problem to maximize the score function which consists of three factors: the similarity score between utterances and slide components, the consistency of the explanation order, and the explanation coverage of slide components. The experimental result on the Corpus of Japanese classroom Lecture
منابع مشابه
Developing Corpus of Lecture Utterances Aligned to Slide Components
The approach which formulates the automatic text summarization as a maximum coverage problem with knapsack constraint over a set of textual units and a set of weighted conceptual units is promising. However, it is quite important and difficult to determine the appropriate granularity of conceptual units for this formulation. In order to resolve this problem, we are examining to use components o...
متن کاملBeyond next Slide, Please": the Use of Content and Speech in Multi-modal Control
The Intelligent Classroom is an automated lecture facility where one of the primary goals is that speakers be able to control it by interacting with it as they would with a human A/V technician. In this paper we describe our research in imbedding Microsoft Powerpoint into the Intelligent Classroom. In particular we discuss how we use two modes of sensing (Computer Vision and Speech Recognition)...
متن کاملAutomatic identification and storage of significant points in a computer-based presentation
We describe an automatic classroom capture system that detects and records significant (stable) points in lectures by sampling and analyzing a sequence of screen capture frames from a PC used for presentations, application demonstrations, etc. The system uses visual inspection techniques to scan the screen capture stream to identify points to store. Unlike systems that only detect and store sli...
متن کاملPatterns of Politeness in Teacher-Student Interaction: Investigating an Academic Context
Patterns of Politeness in Teacher-Student Interaction: Investigating an Academic Context AbstractThis study investigated politeness strategies used in instructor-student relationships, in an academic environment. To conduct the study, four university classes with different instructors were randomly selected, observed and analyzed. Brown and Levinson’s theory of politeness was drawn on as the an...
متن کاملA browsing system for classroom lecture speech
Developing technologies to summarize and retrieve huge quantities of spoken documents, recorded during classroom lectures, for the purpose of e-Learning or self-learning are important. In this paper, we describe an adaptation method of a language model to recognize keywords in given slides. Next, we propose a summarization method for spoken classroom lectures using prosodic features and linguis...
متن کامل